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Abstract 
This report presents a concise review of some frequency estimation and frequency 
tracking problems. In particular, the report focusses on aspects of these problems 
which have been addressed by members of the Frequency Tracking and Estimation 
project of the Centre for Robust and Adaptive Systems. 


The report is divided into four parts: problem specification and discussion, associ- 
ated problems, frequency estimation algorithms and frequency tracking algorithms. 


Part I begins with a definition of the various frequency estimation and tracking 
problems. Practical examples of where each problem may arise are given. A com- 


parison is made between the frequency estimation and tracking problems. 


In Part II, block frequency estimation algorithms, fast block frequency estimation 
algorithms and notch filtering techniques for frequency estimation are dealt with. 


Frequency tracking algorithms are examined in Part III. 


Part IV of this report examines various problems associated with frequency esti- 
mation. Associated problems include Cramér-Rao lower bounds, theoretical algo- 
rithm performance, frequency resolution, use of the analytic signal and model order 
selection. 
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Part I 
Frequency Estimation and Tracking 
Problems 


Frequency estimation and tracking problems, algorithms and related topics are discussed 
in this report. The aim is to present a concise sketch of these problems, describe current 
techniques and indicate loose ends. 

In this Part, several estimation and tracking problems are specified and examined. 
The two problems to be given most scrutiny in the remainder of the report are single-tone 
frequency estimation and single-tone frequency tracking. We discuss the reasons for this 
emphasis. 

Part II of this report describes several block-processing frequency estimation algo- 
rithms, starting with the standard Gaussian, white noise maximum likelihood approach. 
Other approaches discussed include the periodogram maximiser, Fourier coefficient in- 
terpolation and and sample covariance techniques. Details are then given for some fast 
block-processing algorithms which are of interest because of their computational simplic- 
ity. 

The Part concludes with the examination of several notch filtering techniques for 
frequency estimation. The last of these techniques, that of Nehorai and Porat [1986] may 
be used as a frequency tracking algorithm, and so this naturally leads on to Part III where 
several frequency tracking algorithms are examined. 

Further issues such as use of the analytic signal, frequency resolution and model order 
reduction are canvassed in Part IV. 

Rather than list the possible future directions for research on these topics out of 
context, areas where further work is required are indicated throughout the report. 


1 The Frequency Estimation Problem 
There are three main parameter estimation problems which involve frequency estimation: 


e Single tone frequency estimation: where the signal is a single, constant-frequency 
sinusoid. This is the simplest frequency estimation problem. 


e Multi-harmonic frequency estimation: where the signal is composed of the sum of 
harmonically related sinusoids. This case is important because rotational or periodic 
phenomena rarely generate sinusoidal waveforms. 


e Multi-tone frequency estimation: where there are several tones of unrelated fre- 
quency present. This problem occurs in the analysis of signals containing emissions 
from more than one target. 


Each problem assumes a different signal model is to be fitted to measured data. Due 
to the large amount of literature available, this discussion will be confined to the first 
problem, that of estimating the parameters of a single tone in noise. 
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1.1 Single Tone Frequency Estimation 


The single tone in noise parameter estimation problem is defined as follows. 
Problem 1: Single Tone in Noise 
Let {yz} be generated by the model 


Y= t+ pcos(up(t—v)+o)+e; (1) 


where ps is the mean value, p is the signal amplitude, wo is the frequency of the signal, 
US i @ is the initial phase and €; 1s some zero-mean random noise sequence with 


variance o?. 


The single tone in noise problem is then to estimate the real-valued parameters 1, p, 
wo, b and o? given only the measurements {y,:t=0...T — 1}. 


A related problem is estimation of the parameters in the following signal model: 
z= pb + pexpi(wo(t —v) + 6) +. (2) 


where the parameters are as before, except that both yi’ and ¢, are complex-valued. Rife 
and Boorstyn [1974] examined this case. For the majority of this report, however, we 
shall confine our discussion to the real signal model y of (1). 
Remark 1: The signal model (2) is sometimes referred to as the analytic signal (Ville 
[1948]) model. 
In all of these problems, algorithm selection depends on whether the sample size T 
is fixed or increasing. If T’ is fixed, block-processing algorithms are considered. For T 
increasing, on-line algorithms are of interest. 


1.2 Multi-harmonic Frequency Estimation 


Where frequency information is to be gleaned from acoustic sources such as rotating 
machinery, non-linear effects within the generating system often give rise to harmonics 
and sub-harmonics of the fundamental mode of interest. In these situations, (1) does 
not model the physical situation well, so a signal model which accounts for the added 
harmonics should be used. 
Such a signal model is given below. 
Problem 2: Harmonically-related Tones in Noise 
Let {yz} be a multi-harmonic signal modelled by 


Pp 
ye = + > pj cos (jwo(t — v) + b;) + (3) 


j=l 


where pL, Vv, €, anda? are defined as in Problem 1 and wo is now the fundamental frequency 
of the signal, p; is the amplitude of the j* harmonic and ; is the initial phase of the j 
harmonic. 

The multiharmonic-related tones in noise problem is then to estimate the parameters 
Lt, Pj, Wo, bj, 07 and p given only the measurements {y,:t =0...T — 1}. 

The papers by Barrett and McMahon [1987], James, Anderson and Williamson |[1991la 
and James, Anderson and Williamson [1991b] examine the multiharmonic frequency es- 
timation problem. 


1.3 Multi-tone Frequency Estimation 


In certain environments, several tonal sources of differing frequencies may be present in 
the one signal. While, in some cases, it may be possible to apply single-tone techniques in 
this situation, it is more desirable to account for the extra problem complexity by altering 
the signal model. 

The multiple tones in noise problem is defined as follows. 
Problem 3: Multiple Tones in Noise 
Let {yz} be a multi-tonal signal modelled by 


ye = w+ YE pjcos (w;(t — v) + oj) +e (4) 
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where 1, Vv, €, and o? are defined as in Problem 1 and w; is now the frequency of the j™ 
signal component, p; is the amplitude of the j*" tone and ¢; is the initial phase of the j" 
tone. 


The multiple tones in noise problem is then to estimate the parameters |, pj, Wj, 0;, 
o? and p given only the measurements {y,:t=0...T —1}. 

Hannan [1973] has examined this case and Rife and Boorstyn [1976] have examined 
the equivalent complex signal model problem. 


1.4 Frequency Estimation 


In this report, we shall only examine in detail algorithms for the frequency estimation 
problem. The main reason for this is that the added complexity introduced by signal 
models (3) and (4) obfuscates some of the key issues by either introducing new problems 
or by increasing the dimensionality of the problem. 

For instance, use of model (4) instead of (1) means that model order selection now 
becomes an issue. We shall discuss this and other issues further in Part IV. 


2 The Frequency Tracking Problem 


The frequency tracking problem is somewhat more complicated than the estimation prob- 
lem. Three physical situations where frequency tracking is of interest are 


1. decoding digital information from a frequency-shift keyed bit stream, 
2. in demodulation of an FM radio signal and 


3. tracking the revolutions per minute of the engine of a manoeuvring vessel via acoustic 
data. 


Each of these three problems may be described by the following general problem state- 
ment. 


Problem 4: Frequency Tracking 
Let {y.} be modelled by 


= 1 poos (Youn +4) +4 (5) 


k=0 
where w, is called the instantaneous frequency of the signal and p, p, v, o, €, and o? are 
as defined in Problem 1. 
The frequency tracking problem is then to estimate the signal parameters pu, p, @ and 
o and the sequence {w,} given only the measurements {y,:t=0...T —1}. 
Boashash [1992a] gives a general discussion of the problem of instantaneous frequency 
estimation. 


Remark 2: The most notable difference between this problem and Problems 1 to 3 is that 
the estimation of u, p, 6 and o? is a parameter estimation problem, whereas estimation 
of the sequence {w,:k =0...T —1} is a state estimation problem. 
Remark 3: The definition of this tracking problem does not immediately suggest an ap- 
propriate error measure. In parameter estimation problems it 1s common to use the least 
square error criterion. However, in tracking problems, concepts such as ‘loss of track’ or 
‘escape time’ may be of more importance. 

The escape time for the phase locked loop frequency tracker has been examined by 
Dupuis and Kushner [1987]. 

The three physical situations above may be examined by suitable selection of various 
parameters in Problem 4. Because of this different parameter selection, some algorithms 
may be more appropriate to apply to certain problems than others. 


2.1 Demodulation of Digital Signals 


For example, when a frequency-shift keyed bit stream is to be decoded, w, will be at known 
constant values for some duration, which is also perhaps known. While the constant 
frequencies are known, the change from frequency to frequency is generally stochastic. 

Remark 4: In this situation, hidden Markov models are probably the most appropriate 
approach to take due to the discrete nature of process of interest. 


2.2 EFM Demodulation 


For the FM demodulation problem, set 
We = We + AK with We > AK 


where w, is the carrier frequency and A, is the speech signal to be demodulated. The fre- 
quency variation ;, may possibly be modelled as an auto-regressive (or linear predictive) 
process. 

In these cases, the noise is generally fairly small. For instance, because of the effect 
of threshold which is characterised by a severe degradation in reception below some noise 
level, the signal (or carrier) to noise ratio (SNR) for a commercial (stereo) FM station is 
usually required to be 


10 logo > > 20dB. 


o2 
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Remark 5: A major difference between this problem and that of digital signal demodulation 
is that here the frequency variation itself is modelled as being stochastic. 


2.3 Tracking in High Noise 


For the manceuvring vessel problem, w,; will be slowly time-varying while, in general, the 
noise is large. For the underwater case, the operating signal to noise ratio is generally 


10 logo a < —20dB. 


Fortunately, because of a priori knowledge of the working environment, only a small band 
of known frequencies is generally of interest. 

Remark 6: The frequency tracking problem in this situation 1s thus further constrained to 
take place within a known ‘gate’ of possible frequencies. 
Remark 7: A problem that also needs attention is that of deciding whether or not an 
interesting signal is present given knowledge of the background noise. The issues are 
called track initiation or detection and track termination and they are of major concern. 
Oo 


2.4 Frequency Tracking 


Part III of this report examines some particular frequency tracking algorithms, and some 
other aspects of the problem are examined in Part IV. 


Further Work 1: Methods for allowing a priori information about 
the instantaneous frequency law wz to be used should be examined. 


Further Work 2: Block estimators of frequency may be used as 
frequency trackers, provided the frequency variation is slow enough 
over the length of the data. Bounds on the performance of block 
and on-line techniques, for a given amount of frequency variation 
(specified either stochastically or deterministically), would allow 
direct comparisons between such techniques to be made. 


Multi-harmonic and multi-tone extensions of Problem 4 may also be defined, however 
they are not discussed here as this will overly complicate the problem. 


Part II 
Frequency Estimation Algorithms 


We shall categorise frequency estimation algorithms as follows: 


1. block estimators, where the frequency estimate is obtained for a fixed sample size 
T in O(T log T) or more floating point operations, 


2. fast block estimators, where the sample size is again fixed, but the number of oper- 
ations required is O(T), and 


3. on-line estimators, which allow recursively updated frequency estimates to be gen- 
erated. 


This last class of estimators is of particular interest, because they may be more amenable 
to extension to the frequency tracking problem that the block-processing methods. The 
block-processing methods may only be used for tracking when it is known that the instan- 
taneous frequency of the signal does not change significantly over known time periods. 


1 Block Frequency Estimators 


There are several approaches to frequency estimation, given a data set of fixed length T. 
We start by examining the maximum likelihood approach. 


1.1 The Maximum Likelihood Estimator of Frequency 


When « is Gaussian with covariance R,, the maximum likelihood estimator (MLE) of 
frequency is simply the maximiser of the likelihood function given by 


1 ae (Y —¥(0))"RA(¥ — Y(6)) 


L(8) = 
|Pee| 5 


(27) 


) 


vlih 


|A| is the determinant of the matrix A, Y(0) = [fo ji... Gr—1] and 6’ = [u pw 4] with 
He = w+ pcos (w(t —v) + 4) 
with Y the vector of the noisy measurements. Equivalently, the maximiser of the log- 
likelihood function 


oe 


((0) = — 7 in(2n) ~ 5 in(|Ree|) — WYO Bee Y=) 
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(6) 


may be used. If the ¢; are white, then R., = J and maximising (6) is equivalent to 
minimising 

PA 

ys (yy = Gi)? 


t=0 


which is just the least-square error between the data sequence {y;} and the model sequence 
{ii}. 

These functions are usually maximized using a Newton method (Starer and Nehorai 
[1992]). 


1.2 Approximate Maximum Likelihood Techniques 
1.2.1. The Maximiser of the Periodogram 


For the case when the complex signal model of (2) is used, and when p and ¢ are unknown 


and estimated using 
(eal 


pe’ = Dy ye ot 
t=0 
then the maximum likelihood frequency estimate is equivalent to setting 
Tai 
Op =: max we 
420 
= max I,(w) 


where J, is the periodogram of the y. 
For the real signal model of (1), then this equivalence is only asymptotically (T’ — oo) 
true. Hannan [1973] has examined this case and shown that, 


T°? (Op — wo) ~ N(0, 482 p~? fe(wo)) 


where f-(wo) is the spectral density of ¢; at the true frequency. 
Due to the highly non-linear nature of this problem and the many local maxima of I,, 
an initial frequency estimate at least as close as 


|; = wo| = O(T‘) with « > 1 


is needed (Quinn and Fernandes [1991]) if a Gauss-Newton function maximisation tech- 
nique is used. 


Remark 8: Quinn and Fernandes [1991] noted that the length T fast Fourier transform of 
{y.} only yields an initial estimate with 


4; — wo] = O(T~") 


which is not close enough to guarantee convergence of the Gauss-Newton iteration. 


1.3 Fourier Coefficient Techniques 


There are several algorithms which rely on the phase and magnitude of the maximum 
modulus complex Fourier coefficient. Such techniques are useful because they are generally 
computationally simple. The most computationally intensive operations needed are a fast 
Fourier transform and a size T' search to find the maximum modulus coefficient. 

Remark 9: The variance performance of such estimators approaches that of the maximum 
likelihood estimator of frequency, with significantly less computational cost. 
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1.3.1 Fourier Coefficient Interpolation Methods 


Quinn [1992b] has devised the following Fourier coefficient interpolation frequency esti- 
mation algorithms. 


1. Put k equal to the maximiser of the discrete-frequency periodogram 


A 


k = arg max Ome). 


22 Pit 
Aya = 8 (Iy(Qm(k+1)/T)/Ly(2mk)) dy. = Aya /(1— ds) 
G1 = 2 (L(2n(k — L)/T)L(2rk)) 64 = G1/(1- 4-1) 
where #(-) indicates the real part of the argument. 


3. To form the first estimator, Wer, if 64; and 6_; are both positive, set 6 = 041. 
Otherwise set 6 = 6_,. Then 


A 


WPT = 2r(k + OT. 


4. To form the second estimator, Wry, put 


5 = (541 + 5-1)/2 +7641) — 7(8%) 


with 
1 6, fetl—-V3 
t(x) = — log(3x* + 6x + 1) — Vis v3 
4 24 stoke 2 
then set 


Opry = 2n(k + 6)/T. 


Remark 10: Quinn /1994]/ has developed central limit theorems for both estimators. As the 
second technique finds that nonlinear function of 64, and d_, which minimises the mean 
square error, it is not surprising that Wpri2 has the smaller mean square error. 


1.3.2 The Generalised Phase Interpolation Estimator 


When it is desired to use block-processing techniques to track a slow variation in frequency, 
McMahon and Barrett [1986] have described a frequency estimation technique which uses 
the maximal Fourier coefficients from adjacent (possibly overlapping) time-blocks. 

The method proceeds as follows. 


1. Form the length R discrete Fourier Transforms at frequency W: 


R-1 2 R-1 -_ 
A a SS yen B = S- Yirve 
t=0 t=0 


where @ has been chosen to be close to the frequency to be estimated and V is the 
offset between the two time blocks. 
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2. Calculate 
6 = arg(B) — arg(A) 


3. The estimator is then given by 
WPIF = (6 + 2mn)/V. 


The phase ambiguity, 27n/V, may be resolved by choosing another offset V’, re- 
computing Wprp and selecting n and n’ so that |Wpyz — Wpyp| is as small as possible. 


Remark 11: McMahon and Barrett [1987] have extended this technique to the multi-tone 
case and have used this extension to perform multi-component frequency tracking. 


1.4 Sample Covariance Methods 


There are several frequency estimation methods available which rely on maximizing a 
signal spectral estimate other than the periodogram. Thus they may also be considered 
to be approximate maximum likelihood techniques. These spectral estimates are arrived 
at via the eigensystem decomposition of the M x M sample Toeplitz covariance matrix 
of the sequence {y;}: 


Fyy(0) Fyy(1) ee Py (LT _ 1) 
Ri > Fyy(1) Fy (0) Bes (7) 
e “8 Fyy(1) 
Pyy(T 7 1) Pyy(1) Fyy(0) 
where er 
Fyy(m) = T d Yim m=0,...,M—1 (8) 


is the biased covariance estimator where y indicates the complex conjugation of y. The 
biased estimator is used to ensure that Ry, is non-negative definite. 
The Bartlett spectral estimate may be written 


Pgar(w) = v*(w)Ryyv(w) (9) 


where v(w) = [lexp(iw) exp(i2w)...exp(i(N — 1)w)]" and v* indicates the complex con- 
jugate transpose of the vector v. Note that if M = T then this estimate is the same as 
the periodogram spectral estimator. Another popular spectral estimator is the minimum 
variance (Kay [1988, page 428]) spectral estimator given by 
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Puv(w) = vr(w)Retv() (10) 


The various signal subspace and noise subspace approaches substitute rank-reduced 
approximations or rescalings of the sample covariance matrix R,,, (or its inverse), into (9) 
or (10). Both Kay [1988] and Marple [1987] give accounts of these types of spectral (and 
the associated frequency) estimators. 
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Given an eigenvector decomposition of the full-rank Ruy: 


; M 
Rigg = 2 Keke hs 
k=1 
where |A,| > |Ax+i| and ex is the eigenvector associated with A,, then the various methods 
use the following approximations of Ry,,. 


1.4.1 Signal Subspace Methods 


The signal subspace methods use the eigenvectors of Rig corresponding to the p largest 
modulus eigenvalues (maximal eigenvectors) are used, where p is the number of sinusoids 
that are assumed to be present. 


Minimum Variance The principle component minimum variance spectral estimator is 


formed by substitution of 
Pp 


- 1 
ig: = \, chek: 
hai 
into (10). 


Bartlett The principle component Bartlett spectral estimator is found by substituting 
A Jn vt 4 
ase = iv d AKeKep- 
into (9). 


1.4.2 Noise Subspace Methods 


The noise subspace methods use the M — p minimal eigenvectors of Ryy to form an 
approximate inverse covariance matrix. Equation 10 is then maximised over w to find the 
frequency estimates. 


Pisarenko’s Method Pisarenko harmonic decomposition (PHD) (Pisarenko [1973]) uses 
a sample autocovariance matrix of size p+ 1x p+1. The approximate inverse 
covariance matrix for this method is 


D—-1 __ * 
Reis = €p+1€p41- 


MUSIC The multiple signal classification (MUSIC) is a generalization of the Pisarenko 
approach which sets M greater than p+ 1 so that 


M 


ry—1 = * 
Ryusic = ye EKER: 
k=p+1 


13 


Choice of wy 


Author Oe b= 12.7 i 
Lank, Reed and Pollon [1973] oh 
Kay [1989] eer 
Lovell and Williamson [1992] 6t(T—t) 


T(T?—1)lzellzf_4| 


sinh(T@)—sinh(t@) —sinh((T—t)@) 


Clarkson, Kootsookos and Quinn [1994] (=p sah(P6)—2sinh( ET) sinh] }(T—1)8]/ sah( 20) 


where 0 = In (1 


o2 >) 
pe ' V pt ' p? 


Table 1: Proposed choices of window function, wy. 


Remark 12: Unfortunately, most of the estimators of frequency obtained using these meth- 
ods are not asymptotically efficient. As the noise subspace methods tend to perform par- 
ticularly badly (see, for ecample, Kay [1988, Figure 13.6 ] for a comparison) and because 
most are computationally intensive, these methods will not be closely examined in this 
report. 
Remark 13: For the (complex) single tone case, Pisarenko’s method is of interest, because 
here M = 2 and all that 1s required 1s to find the roots of a quadratic polynomial. Hence, 
while this method is statistically inefficient it 1s very fast to calculate, and so the estimate 
it produces may be used to initialise other algorithms. 


2 Fast Block Frequency Estimators 


Many of the techniques discussed previously can be recast to work with the signal model 
of (2). Use of this model also allows another class of estimator to be defined: the weighted 
phase averaging frequency estimators. 

These estimators are of interest because they may be performed in O(7)) floating point 
operations, and so may be considered for use instead of on-line methods in the frequency 
tracking problem. 

The weighted linear predictor form of frequency estimator is given by 


Ted 
A * 
Wo = arg S- We2424_4 


t=1 


where w; is some window function and arg(z) indicates finding the phase (argument) of 
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the complex-valued z. Several different estimators may defined by different selection of 
the window function w,. Table 1 gives a list of possible choices of wy. 

Lovell and Williamson [1992] introduced the signal-dependent form of w,, while Clark- 
son, Kootsookos and Quinn [1994] showed how a class of windows, which depend on the 
SNR, may be generated. For high SNR, the SNR-dependent window is equivalent to Kay’s 
window and for low SNR the SNR-dependent window becomes the rectangular window 
of Lank, Reed and Pollon [1973]. 

Other possible phase-related estimators are the weighted phase averagers of the form 
(Kay [1989]) 

Pt 
wo = Di w; [arg (Zz) — arg (z-1)]- 
t=1 
Quinn [1992a] has shown that, where ¢; is Gaussian and w; is not signal dependent, the 
weighted phase averaging form yields biased estimates of frequency. As a result, we will 
not examine these estimators. Clarkson [1992] has proposed a modification to Kay’s 
estimator which adaptively attempts to circumvent this bias. 


Further Work 3: The statistical efficiency claimed of their estima- 
tor by Lovell and Williamson [1992] must be reconciled with the 
lack of statistical efficiency of the estimators examined in Clarkson, 
Kootsookos and Quinn [1994]. 


3 Notch Filtering Techniques 
Given a {y,} of the form (1), then the y; also satisfy 
Yt — 2C0S(Wo)Ye-1 + Y_a = Et — 2 COS(Wo)Ez_1 + E42. 


This ARMA(2,2) equation system involves pole-zero cancellations, and so its solution is 
not well defined. 

There are several techniques which use this approach (Bhaskar Rao and Kung [1984]; 
Fernandes, Goodwin and de Souza [1987]; Nehorai and Porat [1986]; Quinn and Fernandes 
[1991]). 


3.1 Off-line Filtering Techniques 


While the techniques of Fernandes, Goodwin and de Souza [1987], Quinn and Fernandes 
[1991] are not on-line filtering techniques, they are examined here because they have much 
in common with the on-line methods of Hannan and Huang [1993] and Nehorai and Porat 
[1986]. 


3.1.1 The Technique of Fernandes, Goodwin and de Souza 


The Fernandes, Goodwin and de Souza [1987] frequency estimation technique is described 
as follows. 
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1. Set 7 = 1 and let hy; = 5; be the impulse response of a filter H;(w) where 4; is the 
Kronecker delta. 


2. Set Ue; = hy; * y fort =0,...,7— 1 where * denotes convolution. 


3. Using yf j, obtain a; an estimate of 2 cos(wo) using equation error based least squares. 
If |a; — @;-1| is small enough, set @ = cos~'(@;/2) and terminate the algorithm. 
Otherwise, continue. 


4. Construct a new filter, H;,;(w), the passband of which is highly likely to contain 
the true frequency. Set h;;41 equal to the impulse response of this filter. 


5. Increment j and go to step 2. 


Remark 14: The frequency estimate obtained via the equation error based least squares 
technique is biased, however Fernandes, Goodwin and de Souza [1987] bound this bias. 
This bound is used to set the bandwidth of the filter new filter Hj41(w). 
For the technique to converge, the bandwidth of the filters H;(w) must be shown to 
decrease at each iteration. Conditions under which this is achieved are given in Lemma 4.2 
of Fernandes, Goodwin and de Souza [1987]. An approach which also uses the idea of 
bandwidth contraction is described by Yakowitz [1992]. 
Remark 15: The filters , H;(w), may be any bandpass filter with the appropriately selectable 
passband specifications, e.g. Butterworth filters. 
While some results are given for the variance of this estimator, a similar technique 
described by Quinn and Fernandes [1991] allows easier derivation of a central limit theorem 
for the estimator. 


3.1.2. The Technique of Quinn and Fernandes 


Quinn and Fernandes [1991] have suggested estimating the parameters a and ( in the 
following equation: 
Ye — PYe-1 + Yeo = Ee — OE y_1 + E4-2. 

subject to a = 2. The algorithm proceeds as follows (from Quinn and Fernandes [1991]}): 

1. Set a = a, = 2cos(w;) where w; is some initial estimate of wo and set j = 1. 

2. Filter the data to produce (¢ ; 

Gra her Gag — Gay. t= Qagl=1 
where ¢,,; = 0 for t < 0. 


3. Form (; by regressing (¢,; + Gr-2,;) oN G-1,; 


TH 
0 4Gy + Cr-2,4) G15 
iy ety 


6; = 


A. If ja; — @;| is small enough, set wp = cos”! ($3;) and terminate. Otherwise, put 
aj+1 = 3;, increment j and go to step 2. 
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The effective smoothing window used in the Quinn-Fernandes Method 
T T T T T T T 


-4 3 -2 -l 0 1 2 3 4 
Frequency (radian) 


Figure 1: Plot of wr(w) as a function of frequency. 


The algorithm may be interpreted (Quinn, Hannan and Huang [1993]) as finding a 
local maximum of the “smoothed periodogram” nearest w;. The function maximised is 


mw) = f° Iy(A)ur(w — )ad 


cae 


where 
se 
ur(w) = >> k-* cos(kw). 
k=1 


An example of jz7(w) for T = 16 is plotted in Figure 1. 


Remark 16: The mazximiser of « has the same central limit theorem (Theorem 8 of Quinn 
and Fernandes [1991]) as the periodogram maximiser: 


T?? (Gp — wo) ~ N(0,48rp~? fe(wo)) 


where f-(wo) is the spectral density of the noise at the true frequency. 
Remark 17: The number of iterations required for convergence is small if a good initial 
estimate is used. For example, if @;, 1s the discrete frequency periodogram maximiser, then 
only 2 or 3 iterations are generally sufficient. 
Remark 18: Due to the smoothing involved, the algorithm is robust to poor initial estimates 
w;. Quinn and Fernandes [1991] show via simulation that even using Pisarenko’s frequency 
estimate for w; 1s enough for convergence within 2 to 5 iterations. 


3.2 On-line Filtering Techniques 


Filtering techniques are of interest because it may be possible to modify them to be on- 
line or adaptive. When such techniques are adaptive, it is also possible to use them for 
frequency tracking. 
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3.2.1 The Hannan-Huang Estimator 


Hannan and Huang [1993] noticed that an on-line version of the Quinn-Fernandes esti- 
mator may be formulated as follows. 
Select a threshold parameter e. Initialise, with 7 = 1, 


For t from 0 to JT'— 1: 


1. Set 
G = eGity; ¢1=0 (ty) 
OW = ws s crake 
k=tj+1 
2. Form 1 
Fi(t;) = Gap 
ae hi 


Fits) <6 mes F(t s) 


then set 7 =j+1,t; =t,a =a, and & =0. 
4. Goto step 1. 


Remark 19: The reinitiation step is included because for a given value of A = a — wo, 
t—t, (the time from the last reinitiation) must not be too large. 
Remark 20: From a practical view point, the reinitiation of the algorithm provided by step 
3 is needed because the instability of the state update equation (11) means that |¢;| grows 
approximately linearly in t. 
Remark 21: Huang and Hannan [1993] have reformulated their approach to deal with 
signals modelled with time-varying frequency as in (5). 


3.2.2. The Technique of Nehorai and Porat 


The technique of Nehorai and Porat [1986] (also presented by Nehorai and Porat [1985]) 
is a recursive prediction error (Ljung and Séderstrém [1983]) approach for multi-harmonic 
frequency estimation. A simpler version modified for the single tone case is as follows. 

We are given a noisy sinusoidal sequence, {y,} with y, = 0 fort < 0 andt > 7T-1 
and an initial frequency estimate w;. When t < 0, set 


Oy = W; | a, = —2 cos(a) ; y= MU 
og =0; ¢, =0 ; % =0 
= 5 G=y era) 
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and select dynamics for the variables p;, r:, y, and Az. For t=1 to T’ — 1 perform the 
following recursions. 


x x Vt-1 

We, = Wey + ——We-16:-1 
Tt-1 

G = —2cos(a;) 


Yo = Ye—PrYp-2 — PrQeyy 1 
ot = Ptet_-1 — Yt-1 


, = Plt _ Via 
YW = 2 sin(&;)¢; 
Ce = Yet Yi-2 — Preis — brQt-1 
e; = Yer Yt-2 — Pees — O14r 
= phen — pricy 


The dynamics of p:, 4, 7, and r; are selected so as to satisfy convergence criteria 
set out by Ljung and Sdderstrém [1983]. Nehorai and Porat [1986] selected the following 
dynamics. 


Pitt = popt + (1 — po) Poo 
Nev = AoAt + (1 = Ao) 
Yeo1 = VW/ Ye + A041] 


2 
Toy = Tet Ve cas = r| 


Remark 22: The parameters po, Po and Xo are user selectable. 
The algorithm approximates ¢, by 


Ex = hit H 
where * indicates convolution and h; is (approximately) the impulse response of the filter 


1 — 2cos(&)z71 + 27? 


ao cos(w)271 + p2z-?° 


where p is typically close to, but less than unity, to ensure the stability of H(z). The 
parameter estimate a; is updated so as to reduce 


Poa 
IE 
t=0 
Remark 23: Nehorai and Porat claim that their algorithm is asymptotically statistically 


efficient, however the only proof offered is the statement that their algorithm satisfies 
constraints provided by Ljung and Séderstrém [1983] which ensure the required result. 


Further Work 4: A thorough theoretical investigation of the per- 
formance of this algorithm for both frequency estimation and fre- 
quency tracking is needed. 


Remark 24: Since the Nehorat and Porat estimator is already adaptive, it 1s easily modified 
for the frequency tracking application by suitable choice of the tuning parameters. 
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4 Summary of Frequency Estimation Algorithms 


Table 2 summarizes the various frequency estimators we have examined here. 


4.1 Block Estimators 


Of these estimators, the most attractive would appear to be the estimator of Quinn and 
Fernandes [1991], for several reasons. The estimator is unbiased, asymptotically efficient, 
requires fewer operations than full maximum likelihood and is more robust to initial 
conditions than that algorithm. 


4.2 Fast Block Estimators 


Of the weighted phase averaging estimators, that proposed by Lovell and Williamson 
[1992] has the best performance. The Kay [1989] estimator has similar performance for 
small noise levels, but its bias in the presence of unbounded, in particular Gaussian, noise 
is a problem. 


4.3 On-Line Estimators 


Interest in on-line estimators is because of the hope that they may be modified and applied 
to the frequency tracking problem. The Hannan-Huang estimator has been so modified 
(Huang and Hannan [1993]) and the Nehorai and Porat frequency estimator only requires 
a suitable choice of system dynamics to be used as a frequency tracker. 
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Frequency Estimator Summary 


Paradigm Algorithm Computational Asymptotically 
Complexity Achieves 
Cramér-Rao 
Bound ? 
ML and Maximum Likelihood > O(T log T) Yes 
Approximate 
ML Periodogram Maximiser > O(T log T) Yes 
Discrete-Frequency 

Periodogram Maximiser O(T log T) No 
Fourier FTI1 O(T log T) No 
Coefficient FTI2 O(T log T) No 
GPIE O(T log T) No 
Signal Minimum Variance O(T?) No 
Subspace Bartlett O(T®?) No 
Noise Pisarenko O(T) No 
Subspace MUSIC O(T®?) No 
Phase Lank-Reed-Pollon O(T) No 
Weighted Kay O(T) No 
Averaging Lovell O(T) Yes* 
Clarkson O(T) No 
Filtering Fernandes-Goodwin-de Souza O(T) Yes 
Quinn- Fernandes O(T) Yes 
Hannan-Huang N/A N/A 
Nehorai-Porat N/A N/A 


* Further investigation of the asymptotic performance of this algorithm is needed. 
N/A : Not applicable to on-line estimators. 


Table 2: Summary of Frequency Estimators. 
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Part III 
Frequency Tracking Algorithms 


1 On-line Frequency Trackers 


One reason for interest in on-line estimators of frequency is that some applications may not 
have access to blocked data and thus require continuously updating frequency estimates. 
Our major interest in these estimators is that they may lead to algorithms which tackle 
the the problem of frequency tracking or FM demodulation. 


’Differentiator Response’ 


2 : 5 


2 


Frequency (radian) 
Low Pass Filter Response 
1 1 1 


0 0.5 1 1S 2 2.5 3 3.5 
Frequency (radian) 


Figure 2: Filter magnitude responses used in the simple ap- 
proach. 


1.1 A Simple Filtering Approach 


A continuous-time, analytic, noiseless, frequency modulated signal may be converted to 
an amplitude modulated waveform by differentiation: 


uw + pexp (wf w(t)dt + 0) 
oo =, wees (wf oat z 6) | 


RY 
fs 

= 
Meee 


An envelope detector can then be applied to extract w(t) from z(t). 
Similarly, in discrete-time, the differentiation operation may be approximated by pass- 
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ing the complex signal 


t 
2% = pw’ + pexp (ite + Sod + ‘)) ’ 


k=0 


with w,. >> Ax, through a linear-phase finite impulse response filter with magnitude re- 
sponse illustrated in the top diagram of Figure 2. 

In the Figure, it is assumed that w. = 7/2. The dotted lines in the top diagram 
indicate that the filter gain at w, is unity, and the dashed line indicates that the slope of 
the magnitude response at w, is also unity. 

The modulus of the filtered signal is then taken, and the result passed through a low 
pass filter with magnitude response given in the bottom diagram of Figure 2. 


1.2 The Extended Kalman Filter 


As noted in Remark 2, frequency tracking problems are state estimation (or prediction) 
problems — which are routinely solved using Kalman and extended Kalman filters. 

With any application of Kalman filtering techniques, a signal model must first be 
specified. For example, the following signal model: 


GS sin ([ 0 1x) +e (12) 


with noise variance Ele,¢,] = 026,-, and frequency variance E/vv.] = 0264_. 
Since the output equation (12) is non-linear, the extended Kalman filter equations 


Eye = Lyi + Lt lm — sin (V4.1) 
Lesile = Posy 
Lie = Depa” 
OO, HyDajp-1H, + 02 
elk = Ueki — Vee—-1 OQ, | Ay De|e—1 
FY gpk” + o3GG 


lcos (U'E,4.-1) 


Uk+1|k 
FA; 


must be used (see Anderson and Moore [1979, page 195]). 
Anderson and Moore |1979, pages 200-204] assume a sampled continuous-time signal 
rather than using a wholly discrete model. 
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Remark 25: James [1992], Anderson, James and Williamson [1992] and James, Anderson 
and Williamson [1991a] have examined augmenting this signal model to take account of 
the the multi-harmonic frequency tracking and estimation problems. 
Remark 26: An aspect of the discrete-time frequency demodulation problem that these 
state-space approaches do not generally take into account is that the frequency estimate 
can only ever be in the range |0,27| for the complex signal case and [0,7] for the real 
signal case. 

Anderson and Moore [1979] and Tam and Moore [1977] give some discussion on this 
point. Aspects of discrete-time frequency estimation are also discussed by Lovell, Koot- 
sookos and Williamson [1991]. More general estimation problems on the circle are exam- 
ined in the series of three papers by Lo and Willsky [1975c] and the two papers of Willsky 
[1974]. 

For recursive discrete estimation, see the papers by Bitmead [1982], Bitmead and 
Anderson [1981] and Bitmead, Tsoi and Parker [1986]. 


1.3. The Gaussian ‘Sum’ Approach 


The extended Kalman filter involves a linearisation of the problem around the current 
state, 2. Tam and Moore [1977] and Anderson and Moore [1979] have shown that an 
improvement in the demodulation performance of the extended Kalman filter may be 
obtained by using a bank of M such filters which are linearised about different points in 
the state-space. Each filter in the bank may have 


e different initial states, 2p ;, 
e different frequency variances, Ook or 


e different measurement noise variances, 7? ,. 


After all filters are applied to the data several state estimates, Crd are obtained. The 


final state estimate is given by 
M 


ox, 1 rae 
Lee = S- Oe kL elt 
k=1 


where 
O4-1,k'Y @ — sin (Uae) Qn) 
Obk = Ty 
Se Ot4-1,nY (u — sin (U'G4-1°) Ge) 
n=1 
and 


1 1 Iy-1 r— 
Toe ay ea (x — p)). 


This approach involves approximating a non-Gaussian probability density function by 
a sum of Gaussian probability density functions. Such sums of Gaussian densities are 
usually referred to as Gaussian mixtures to avoid confusion with the addition of Gaussian 
random variables. 
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2 Hidden Markov Model Approaches 


By imposing much structure on particular estimation problems, hidden Markov models 
(HMMs) have been used to good effect in the frequency tracking problem. Two approaches 
have been reported: frequency line tracking (Streit and Barrett [1990]) and a phase- 
frequency demodulation approach (White [1992]). 

Other authors writing about these and similar methods include Barrett and Holds- 
worth [1992], Xie and Evans [1991] and Xie and Evans [1993). 


Further Work 5: One problem which needs to be addressed and is 
associated with the HMM approaches to frequency tracking is that 
of automatic model-parameter estimation. Automatic discretisa- 
tion selection for the variable to be estimated when that variable is 
inherently continuous is another concern that needs to be examined. 
Other problems associated with HMMs are discussed by Anderson, 
James and Williamson [1992]. 


3 Summary of Frequency Tracking Algorithms 


Frequency tracking procedures not covered in this report include the well-known phase 
locked loop (Kelly and Gupta [1972]; Polk and Gupta |[1973]) and several of those discussed 
in Boashash [{1992b]. The maximum likelihood polynomial phase method is one method 
described there which should be examined. Some authors see the phase locked loop as a 
simplification of the extended Kalman filter approach (James [1992]). 

Estimators described by Boashash [1992b] based on time-frequency representations 
are extremely computationally intensive, and have been shown by Kootsookos, Lovell and 
Boashash [1992] to be arithmetically equivalent to weighted linear predictor techniques. 
Remark 27: One technique which may be worth investigation, but which has not been 
discussed here, is the probabilistic data association technique of Bar-Shalom and Fortmann 
[1988]. This method is of particular interest, because constraints such as track initiation 
(Colegrove [1992]) and track termination (Musicki, Evans and Stankovic [1992]) may be 
included in the algorithm formulation. 
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Part IV 
Associated Problems 


Along with the frequency estimation and tracking problems discussed in Part I , there are 
several associated problems which deserve discussion. These other problems include: 


e Availability of Cramér-Rao lower bounds on the variance of unbiased parameter 
estimators and whether a particular estimator meets these bounds (is statistically 
efficient). 


e Which performance indicators to use for the frequency estimation and tracking 
problems other than statistical efficiency (e.g. threshold onset). 


e Whether to use the analytic signal or the real signal and, if the analytic signal should 
be used, how best to calculate it given only the real signal. 


e Can the frequencies of two close-in-frequency tones be estimated accurately using 
frequency estimation algorithms. This is sometimes called the frequency resolution 
problem. 


e For the multi-harmonic and multi-tone problems, the extra parameter which must 
be estimated is p, the model order. The robustness of multi-frequency algorithms 
to incorrect estimation of p should be examined. 


e As indicated previously, when the frequency tracking problem is to be conducted 
in a high noise environment, the problems of track initiation and track termination 
become important. 


We shall now examine some of these points. 


1 Cramér-Rao Lower Bounds 


The Cramér-Rao lower bound on the variance of an unbiased estimator of the frequency, 
wo of a signal tone in noise is (see, for example, Rife and Boorstyn [1974]) 


196 


Tr 1 ion 


var (wo) > 


For the multiharmonic frequency estimation problem, Barrett and McMahon [1987] have 
derived the analogous bound, which is 


1267 


_ 
P(T? 1) ok 
k= 1 


var(W9) > (14) 


Remark 28: Note that the effective signal energy is proportional to \R_, k?p2 rather than 
abe 
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Remark 29: Jf an estimator is unbiased, and its variance approaches the Cramér-Rao 
lower bound as the sample size increases, then the estimator is said to be asymptotically 
efficient. 


For the frequency tracking problem, asymptotic efficiency is generally not well de- 
fined, for obvious reasons. However, Peleg, Porat and Friedlander [1993] have derived 
Cramér-Rao bounds on the variance of instantaneous phase and instantaneous frequency 
estimators when the phase is known to be polynomial. The results are extended to the 
case of a continuous-phase signal in Peleg, Porat and Friedlander [1993]. 


2 Performance Indicators 


2.1 Performance of Frequency Estimation Algorithms 


Several performance indicators, other than asymptotic efficiency, may be of importance 
in the evaluation of frequency estimation algorithms. These include estimator bias, small 
sample size performance, computational complexity, and the thresholding performance of 
the estimators. 


Estimator Bias Clearly, if we wish an estimator to be accurate then a major requirement 
should be that the estimator be asymptotically unbiased, i.e. 


E [w = Wo| =0 
as the sample size increases (T’ — oo). 


Unfortunately, it may not be obvious under what conditions a particular estimator 
is unbiased. For example, Quinn [1992a] has shown that Kay [1989] estimator is 
only unbiased when the amplitude of the noise is bounded — a condition which does 
not hold under the Gaussian noise assumption. 


Small Sample Size Performance In some frequency estimation problems, only a small 
number of data points are available. In this case, asymptotic performance is not 
pertinent and any algorithm used must perform well on finite sample sizes. 


Computational Complexity In real-time applications, the computational complexity 
of the algorithm used may be important. 


Thresholding Analysis For some estimators it is possible to predict behaviour at all 
SNRs accurately. 


This last point is particularly important as when the SNR is low, most estimators ex- 
hibit the thresholding phenomenon — which represents a marked decrease in performance 
for a relatively small change in SNR. 


Further Work 6: A major study, incorporating these performance 
indicators, of the frequency estimators mentioned in Part II (and 
others) needs to be undertaken. 


We give a brief account of various analyses which have been performed on some of the 
frequency estimation algorithms given in Part II. 


Zt 


2.1.1 Approximate Maximum Likelihood Frequency Estimator Performance 


Rife and Boorstyn [1974] have analysed the performance of the frequency estimator based 
on the maximiser of the periodogram. Recently, Quinn and Kootsookos [1994 ] have ob- 
tained expressions which are simplified compared to those of Rife and Boorstyn. Figure 3 
is a root mean square error versus SNR plot for various sample sizes obtained using the 
formulae presented in Quinn and Kootsookos [1994 ]. 

Another, different, approach is presented in James, Anderson and Williamson [1992a]. 
Remark 30: Note that Rife and Boorstyn [1974] incorrectly state that they assume that the 
imaginary part of the additive noise 1s the Hilbert transform of the real part. If this were 
true, the real and imaginary parts of the noise would be correlated and the noise would 
therefore be coloured. 

The analyses presented by both Rife and Boorstyn [1974] and Quinn and Kootsookos 
[1994 | rely on the assumptions that 


e the true frequency being a Fourier frequency (i.e. if the sample size is T then 
wo = 2k /T) and 


e the initial coarse frequency search is conducted over only the Fourier frequencies, 
pH 2k, b= O15 2..2., PF aT, 


If either of these conditions is not met, then a decrease in the effective signal to noise 
ratio occurs. 


Further Work 7: The analysis of Quinn and Kootsookos [1994 | 
should be extended to the real signal model and the approximate 
analytic signal cases. 


Karan, Williamson and Anderson [1994] have analysed the case of model mismatch in 
the maximum likelihood frequency estimator, when the true signal has a frequency which 
is linearly increasing with time. 


Further Work 8: The work presented by Karan, Williamson and 
Anderson [1994] yields upper bounds on the penalty for assuming 
a constant frequency when in fact the signal has a linear frequency 
sweep. The bounds are not tight, and another approach, hopefully 
yielding tighter bounds, should be found. 


James, Anderson and Williamson [1992b] and Williamson et al. [1994] have analysed 
the threshold performance of the multi-harmonic maximum likelihood frequency estima- 
tor. One of the main thrusts of Williamson et al. [1994] was to show that, for intermediate 
SNRs, rational harmonic outliers are the overwhelming mechanism by which the multi- 
harmonic maximum likelihood algorithm fails. 

Figure 4 shows the theoretically derived and simulated results for the probability of 
A. rational harmonic outliers, B. noise-only outliers and C. any outlier. Comparison of 
A. and B. shows that, for intermediate SNRs, the rational harmonic outliers have a much 
higher probability of occurring than does a noise-only outlier. 


Further Work 9: Further work needs to be done to modify the 
algorithm to detect and reduce such rational harmonic outliers, 
and thereby improve the threshold-region performance of the algo- 
rithm. 
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Figure 3: Performance curves for the Maximum Likelihood 


Estimator of frequency (complex signal case). 
The following curves are displayed: 


— Theoretical Root Mean Square’ Error 
(RMSE) versus SNR for sample sizes T = 
16 (topmost curve), 32, 64, 128, 256, 512 
and 1024 (bottom curve). 


o Sample RMSE versus SNR for sample size 
T = 16. Number of realisations per sample 
point is 2000. 


x Sample RMSE versus SNR for sample size 
T = 1024. Number of realisations per sam- 
ple point is 2000. 


constant probability of an outlier curves for 
@= 1410S toga ix 0 
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A. Theoretical and Simulated Probability of a Rational Harmonic Outlier (p=3) 


B 
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C. Theoretical and Simulated Probability of Any Outlier (p=3) 
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Figure 4: Outlier probability curves for the multiharmonic 
maximum likelihood estimator. The following 
curves are displayed: 


A. (—) The probabilty of a rational harmonic 
outlier versus SNR calcualted theorecti- 
cally. 


A. (x) The probabilty of a rational harmonic 
outlier versus SNR obtained via simulation. 


B. (—) The probabilty of a noise outlier ver- 
sus SNR obtained theoretically (upper and 
lower bounds). 


B. (x) The probabilty of a noise outlier versus 
SNR obtained via simulation. 


C. (—) The probabilty of any outlier versus 
SNR obtained theoretically. 


C. (x) The probabilty of any outlier versus 
SNR obtained via simulation. 
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2.1.2 Weighted-Phase Frequency Estimator Performance 


Clarkson, Kootsookos and Quinn [1994] have analysed the performance of a class of 
weighted-phase frequency estimators, and have shown that such estimators are not asymp- 
totically statistically efficient. What can be shown about the variance of such estimators 
is that they approach the Cramér-Rao lower bound for fixed sample size and large signal 
to noise ratio. 

The analysis presented by Clarkson, Kootsookos and Quinn [1994] does not account 
for signal dependent (and therefore noise dependent) windows as examined by Lovell and 
Williamson [1992]. The analysis of weighted-phase frequency estimators which use signal 
dependent window functions presented there indicates that the variance of the estimators 
approaches the Cramér-Rao lower bound even for moderate signal to noise ratios. 

The simulation studies presented by Lovell and Williamson [1992] suggest better per- 
formance of their estimator than those of Kay [1989]. 


3 The Analytic Signal 


Many algorithms for frequency estimation, particularly the weighted phase-averaging tech- 
niques, rely upon the signal under analysis being analytic (Ville [1948]). Given that real- 
world data is not analytic (complex-valued), there is the issue of how the imaginary part 
of an analytic signal is generated and, consequently, how this problem affects statistical 
theory based on the analytic signal assumption. 

Remark 31: Very few results are available on the statistical effect that estimation of the 
quadrature signal has on frequency estimation procedures which assume it is available. 


Figure 5 displays some simulation results where this effect is examined. The three 
frequency modulated signals 


UV; sin (wot TF oy) + & 
yy = yf +iH [yf] 
yy = exp(i(wot + ¢)) +e; 


were produced, with ¢;, the real part and imaginary part of <j independent, identically 
distributed white Gaussian noise sequences and Hy] indicating formation of an approx- 
imation to the Hilbert transform of y. The appropriate extended Kalman filter formu- 
lations of Anderson and Moore [1979, pp. 200-202] were then used to demodulate the 
two. 

Remark 32: The Figure indicates the improved performance of algorithms which use both 
in-phase and quadrature components. 
Remark 33: The demodulation performance of the EKF for the two in-phase and quadrature- 
phase sampled signals (yb and y$) is almost identical. This is despite not taking into 
account in the EKF signal model the noise colouration of yt. 
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Plot of SNR versus RMSE for three different FM demodulation schemes. 
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Figure 5: Plot of average frequency root mean-square error 
versus SNR for three different FM demodulation 
problems. 


Further Work 10: An analysis of the effects of using 
e the ideal analytic equivalent signal and 
e block and on-line estimates of the analytic equivalent signal 


in conjunction with the various frequency estimation and tracking 
algorithms needs to be conducted. 


The authors Rihaczek [1966], Bedrosian [1963] and Nuttall [1966] have proved various 
results about narrow-band frequency modulated signals and their Hilbert transforms. 


4 Frequency Resolution 


When the signal of interest is two closely spaced sinusoids 


pate Ona ts Gok ((wo +5 )(t-v) + 6) aig (15) 


then Hannan and Quinn [1989] have shown that one-dimensional periodogram techniques 
are outperformed by the maximiser of the regression sum of squares. The regression sum 
of squares for the signal model of (15) will be a function of two variables, wo and a. 


Other approaches are discussed by van Hamme [1991] and Lee [1992]. 
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5 Model Order Selection 


In any model-based scheme, the issue of appropriate model complexity or model order 
arises. In the multi-tone and multi-harmonic frequency estimation problems, this is the 
selection of p, the model order. If p is too large, then spurious frequencies may appear to 
be present; if p is too small, then important information about some frequencies may be 
lost. 

The standard method for model order selection in auto-regressive modelling is the 
automatic information criterion or AIC proposed by Akaike [1974]. Quinn [1989] and 
Hannan [1992] have suggested modifications to this criterion. 


Further Work 11: Further study of both model order selection and 
the robustness of particular estimators to inaccurate order esti- 
mates is required. Some work on this last point, for the multihar- 
monic case, has been reported in Williamson et al. [1994]. 


6 Summary of the Associated Problems 


This ends the section on problems associated with frequency estimation and tracking. 
The main problems identified here which need further work are the effect of using the 
analytic signal for either problem and a full theoretical and experimental comparison of 
the suite of frequency estimators available. 

The next two parts of this report detail some frequency estimation (Part II) and 
frequency tracking (Part III) algorithms. 
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